TITLE OF THE INVENTION 

APPARATUS AND METHOD OF MULTIPLE DECODING 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

[0001] The present invention relates generally to an apparatus and 
a method of multiple decoding, and more specifically, to apparatuses 
and methods of reproducing a plurality of data designated from one 
MPEG (Moving Picture Experts Group) transport stream composed of a 
10 plurality of encoded data. 

Description of the Background Art 
[0002] In recent years, satellite television broadcasting, cable 
television broadcasting and ground wave television broadcasting have 
15 been digitized, so that a broadcasting station can transmit a 
plurality of video and audio data. In a receiver, it is possible 
to receive the plurality of video and audio data, and selectively 
display by video and output by audio any of the data. That is, a 
user can select and view any one of a plurality of video and audio 
20 transmitted by the broadcasting station. 

[0003] A conventional decoder used in such a receiver will be 
described with reference to Figs. 7 to 9 . 

Fig. 7 is a block diagram showing the configuration of a 
conventional decoding apparatus. Fig. 8 is a diagram showing a 
25 specific example in which data representing video and audio and other 
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data are multiplexed on an MPEG transport stream. Fig. 9 is a flow 
chart for explaining processing performed by the conventional 
decoding apparatus. 

[0004] As is well known, the MPEG transport stream is a stream data 
5 string in a data format defined in the ISO/IEC13818-1 standard for 
data transmission and receiving, and is composed of units called 
packets. On the side of a transmitter, data representing a plurality 
of video and audio and other data are respectively stored in payload 
portions of the packets, and the packets are then multiplexed, to 

10 compose an MPEG transport stream (Fig. 8) for transmission toward 
a receiver. On the other hand, on the side of the receiver, it is 
possible to judge a header portion of each of the packets composing 
the MPEG transport stream, to selectively obtain the data 
representing video and audio and other data. 

15 The conventional decoding apparatus receives the MPEG 

transport stream including encoded data representing a plurality of 
video and audio. A method of selecting the inputted MPEG transport 
stream is not required in describing the background art. Further, 
modulation and demodulation control is performed depending on a 

20 satellite, a cable, and a ground wave and hence, the description 
thereof is omitted herein. Consequently, the following description 
will be made using as a premise a state where the corresponding MPEG 
transport stream has already been selected. 

[0005] In Fig. 7, the conventional decoding apparatus comprises 
25 a data extractor 701, a buffer 702, a decoder 703, a buffer manager 
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704, a decoding controller 705, and a reproduction controller 706. 

First, the reproduction controller 706 instructs the decoding 
controller 705 to start decoding (step S901). The decoding 
controller 705 which has received the instruction instructs the 
5 decoder 703 to start decoding (step S902), and instructs the buffer 
manager 704 to start data input to the buffer 702 (step S903). The 
reproduction controller 706 then instructs the data extractor 701 
to extract a packet having desired header information from the 
inputted MPEG transport stream (Fig. 8), the packet having "Header 

10 1" in its header portion in this example (step S904). 

[0006] When the extraction instruction is issued to the data 
extractor 701, the input of the MPEG transport stream externally- 
supplied to the data extractor 701 is started (step S905) . The data 
extractor 701 sequentially extracts the packets each having "Header 

15 1" designated from the MPEG transport stream, and stores in the buffer 

702 the data stored in the payload portions of the extracted packets 
( step S906 ) . The decoder 703 obtains the data stored in the buffer 
702 , and sequentially performs the decoding ( step S907 ) . The decoder 

703 confirms whether or not the decoded data, corresponding to a 
20 predetermined unit to be outputted, is ready for output (step S908.) . 

The predetermined unit to be outputted is a frame in the case of video 
data, for example. In the confirmation in the step S908, when the 
decoded data , corresponding to the predetermined unit , are not ready 
for output yet, the decoder 703 continues the decoding of the 
25 subsequent data (steps S905 to S907) to wait for data. When the 



decoded data, corresponding to the predetermined unit, are ready for 
output , the decoder 703 outputs the decoded data in the predetermined 
unit (step S909) . 

[0007] In the above-mentioned decoding apparatus, however, only 
5 one of the encoded data representing video and audio existing in the 
one MPEG transport stream can be decoded and reproduced. 

Also, in the conventional decoding apparatus, there exists no 
method of sufficiently correcting any error which has occurred at 
the time point of broadcasting from a broadcasting station or in a 
10 transmission path. 

SUMMARY OF THE INVENTION 

[0008] Therefore, an object of the present invention is to provide 

an apparatus and a method of multiple decoding, which makes it 
15 possible to simultaneously decode a plurality of encoded data, and 

to recover the decoding when an error occurred in certain decoding. 

[0009] The present invention has the following features to solve 

the problem above. 

A first aspect of the present invention is directed to a 
20 multiple decoding apparatus receiving a signal composed of a 

plurality of encoded data for simultaneously decoding two or more 

of the data, and the multiple decoding apparatus includes: 

a reproduction controller for outputting various types of 

control information related to decoding and reproduction of the data; 
25 a data extractor receiving the signal for extracting the two 



or more data designated by the control information; 

a buffer storing the data extracted by the data extractor; 

a buffer manager for controlling the buffer in accordance with 
the control information for the buffer; 
5 a data flow controller for distributing the data stored in the 

buffer for each type and transferring the data in accordance with 
provided transfer conditions; 

a plurality of separate buffers for respectively storing the 
data distributed and transferred by the data flow controller; 
10 a separate buffer manager for respectively controlling the 

separate buffers in accordance with information related to the 
specification of the separate buffer; 

a plurality of decoders respectively corresponding to the 
plurality of separate buffers for decoding the data stored in the 
15 separate buffers and outputting the decoded data; and 

a decoding controller for selecting the separate buffer and 
the decoder which are used for the decoding in accordance with the 
control information, and outputting information related to the 
selected separate buffer, the transfer conditions based on the 
20 selected separate buffer, and an instruction to start the decoding, 
respectively, to the separate buffer manager, the data flow 
controller, and the selected decoder. 

[00101 According to the first aspect, even when a single signal 
composed of a plurality of encoded data, for example, one MPEG 
25 transport stream is inputted, desired ones of the plurality of data 



can be simultaneously decoded. 

[0011] Preferably, 

the buffer manager outputs, when the buffer becomes full of 

the data, an overflow notification to the reproduction controller, 
5 the reproduction controller outputs, upon receipt of the 

overflow notification, an instruction to stop the data extraction 

to the data extractor, and outputs an initialization instruction to 

the decoding controller; 

the decoding controller outputs, upon receipt of the 
10 initialization instruction from the reproduction controller, an 

instruction to initialize all the plurality of separate buffers to 

the separate buffer manager, outputs to the buffer manager an 

instruction to initialize the buffer, and respectively outputs 

instructions to stop the decoding to all the plurality of decoders., 
15 the buffer manager initializes the buffer in accordance with 

the initialization instruction from the decoding controller, 

the separate buffer manager initializes all the plurality of 

separate buffers in accordance with the initialization instruction 

from the decoding controller, and 
20 all the processing which is stopped is resumed after all the 

buffer and the plurality of separate buffers are initialized. 

[0012] Even when the buffer overflows due to the occurrence of 

any error, therefore, it is feasible to recover unsuccessful decoding 

due to the error. 
25 [0013] More preferably. 



the separate buffer manager outputs, when the specific 
separate buffer becomes full of the data, an overflow notification 
that the specific separate buffer overflows to the decoding 
controller , 

5 the decoding controller outputs , upon receipt of the overflow 

notification that the specific separate buffer overflows, an 
instruction to stop the data transfer to the specific separate buffer 
to the data flow controller, outputs an instruction to stop the 
decoding to the decoder corresponding to the specific separate buffer, 

10 and outputs to the separate buffer manager an instruction to 
initialize the specific separate buffer, 

the separate buffer manager initializes the specific separate 
buffer in accordance with the initialization instruction from the 
decoding controller, and 

15 all the processing which is stopped is resumed after the 

specific separate buffer is initialized. 
[ 0014 ] Furthermore , preferably , 

the separate buffer manager outputs, when the specific 
separate buffer becomes full of the data, an overflow notification 

20 that the specific separate buffer overflows to the decoding 
controller, 

the decoding controller outputs, upon receipt of the overflow 
notification that the specific separate buffer overflows, an 
instruction to discard the data directed toward the specific separate 
25 buffer to the data flow controller, outputs an instruction to stop 



the decoding to the decoder corresponding to the specific separate 
buffer, and outputs to the separate buffer manager an instruction 
to initialize the specific separate buffer, 

the separate buffer manager initializes the specific separate 
5 buffer in accordance with the initialization instruction from the 
decoding controller, and 

all the processing which is stopped is resumed, and the discard 
of the data is released after the specific separate buffer is 
initialized. 

10 [0015] Even when one or two or more separate buffers overflow due 
to the occurrence of any error, therefore, it is feasible to recover 
the decoding in which a problem occurs due to the occurrence of an 
error . 

[0016] A second aspect of the present invention is directed to a 
15 multiple decoding method, in which a signal composed of a plurality 

of encoded data is inputted, to simultaneously decode two or more 

of the data, comprising the steps of: 

inputting the signal and extracting the two or more data to 

be decoded and reproduced; 
20 storing the extracted data in a buffer; 

distributing the data stored in the buffer for each type and 

respectively storing the data in the plurality of separate buffers; 

and 

respectively decoding the data stored in the plurality of 
25 separate buffers and outputting the decoded data. 



[0017] According to the second aspect, even when a single signal 
composed of the plurality of encoded data is inputted, desired ones 
of the plurality of data can be simultaneously decoded. 
[0018] Preferably, 
5 the method further includes, when the buffer becomes full of 

the data, the steps of 

stopping extraction and decoding of the data, 
initializing all the buffer and the plurality of separate 
buffers , and 

10 resuming all the processing which is stopped after all the 

buffer and the plurality of separate buffers are initialized. 
[0019] Even when the buffer overflows due to the occurrence of any 
error, therefore, it is feasible to recover unsuccessful decoding 
due to the error. 
15 [0020] More preferably, 

the method further includes , when the specific separate buffer 
becomes full of the data, the steps of 

stopping the distribution of the data into the specific 
separate buffer and the decoding of the data stored in the specific 
20 separate buffer, 

initializing the specific separate buffer; and 
resuming all the processing which is stopped after the specific 
separate buffer is initialized. 
[0021] Furthermore, preferably, 
25 the method further includes , when the specific separate buffer 



becomes full of the data, the steps of 

discarding the data directed toward the specific separate 
buffer, 

stopping the decoding of the data stored in the specific 
5 separate buffer, 

initializing the specific separate buffer, and 
resuming all the processing which is stopped after the specific 
separate buffer is initialized, and releasing the discard of the data . 
[0022] Even when one or two or more separate buffers overflow due 
10 to the occurrence of any error, therefore, it is feasible to recover 
unsuccessful decoding due to the error. 

[0023] These and other objects, features, aspects and advantages 
of the present invention will become more apparent from the following 
detailed description of the present invention when taken in 
15 conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0024] FIG. 1 is a block diagram showing the configuration of each 
of a multiple decoding apparatus according to an embodiment of the 
20 present invention; 

Figs. 2 and 3 are flow charts showing the procedure for 
processing performed by the multiple decoding apparatus according 
to the embodiment of the present invention; 

Fig. 4 is a flow chart showing the procedure for processing 
25 in a case where a buffer 120 overflows; 
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Figs. 5 and 6 are flow charts showing the procedure for 
processing in a case where a separate buffer 14i overflows; 

Fig. 7 is a block diagram showing the configuration of a 
conventional decoding apparatus; 
5 Fig. 8 is a diagram for explaining an MPEG transport stream; 

and 

Fig. 9 is a flow chart showing the procedure for processing 
performed by the conventional decoding apparatus. 

10 DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0025] Referring now to the drawings, description is made of a 

multiple decoding apparatus provided by the present invention. 

Fig. 1 is a block diagram showing the configuration of each 

of a multiple decoding apparatus according to an embodiment of the 
15 present invention. Figs. 2 to 6 are flow charts for explaining the 

procedure for processing in a multiple decoding method respectively 

carried out by the multiple decoding apparatus according to the 

present embodiment. 

Description is now made of the outline of the configuration 
20 of the multiple decoding apparatus according to the present 

embodiment . 

[0026] In Fig. 1, the multiple decoding apparatus according to the 
present embodiment comprises a data extractor 110, a buffer 120, a 
data flow controller 130, n (n is an arbitrary integer) separate 
25 buffers 141 to 14n, n decoders 151 to 15n, a buffer manager 160, an 



separate buffer manager 170, a decoding controller 180, and a 
reproduction controller 190. 

[0027] The data extractor 110 outputs data which coincides with 
conditions set from inputted data. The buffer 120 temporarily stores 
5 the data extracted by the data extractor 110. The data flow 
controller 130 respectively transfers the data inputted from the 
buffer 120 to the separate buffers 141 to 14n in accordance with the 
set conditions. The separate buffers 141 to 14n are prepared for 
the decoders 151 to 15n, to store the data transferred from the data 

10 flow controller 130. The decoders 151 to 15n respectively decode 
the data stored in the separate buffers 141 to 14n . The buffer manager 
160 manages the buffer 120. The separate buffer manager 170 
respectively manages the separate buffers 141 to 14n. The decoding 
controller 180 respectively controls the decoding performed by the 

15 decoders 151 to 15n. The reproduction controller 190 provides an 
instruction to select , out of the data inputted to the data extractor 
110, the data to be decoded and reproduce the selected data. 
[0028] Referring now to Figs. 2 to 6, description is made of the 
multiple decoding method respectively carried out by the multiple 

20 decoding apparatus according to the present embodiment. 

Description is herein made, taking as an example a case where 
data respectively stored in three packets using "Header 1", "Header 
2" and "Header 3" as their header portions are reproduced. That is, 
in Fig. 2, m = 3. 

25 [0029] In this case, the reproduction controller 190 outputs a 



decoding start instruction to the decoding controller 180 in order 
to reproduce the data stored in the three packets (step S201) . The 
decoding controller 180 which has received the instruction selects , 
out of the decoders 151 to 15n, the three arbitrary decoders, which 
5 are not used at that time. In this example, the decoders 151 to 153 
shall be selected (steps S202 and S203) . When a required number of 
decoders cannot be selected because they have already been used for 
another decoding, the decoding may be caused to wait until the all 
required number of decoders can be selected, or, if any decoder can 
10 be selected, the decoding in the selected decoders may be performed 
in advance. 

[0030] The decoding controller 180 respectively instructs the 
selected three decoders 151 to 153 to start the decoding (step S204) . 
Further, the decoding controller 180 outputs, in order to 

15 respectively issue data input start instructions to the separate 
buffers 141 to 143 connected to the selected decoders 151 to 153, 
an instruction to start data input to the separate buffer manager 
170 (step S205) . 

The decoding controller 180 then sets in the data flow 

20 controller 130 conditions for transferring the data stored in the 
packet having "Header 1" , the data stored in the packet having "Header 
2" , and the data stored in the packet having "Header 3" , respectively, 
to the separate buffer 141, the separate buffer 142, and the separate 
buffer 143 (step S206). The data flow controller 130 starts the 

25 transfer of the data stored in the buffer 120 to each of the separate 



buffers 141 to 143 on the basis of the conditions set by the decoding 
controller 180 (step S207). The decoding controller 180 then 
instructs the buffer manager 160 to start data input to the buffer 
120 (step S208). Thereafter, the reproduction controller 190 
instructs the data extractor 110 to extract the packets respectively 
having "Header 1" , "Header 2" and "Header 3" in their header portions 
(step S209). Consequently, the input of the MPEG transport stream 
externally supplied to the data extractor 110 is started (step S210) . 
[0031] When the data extractor 110 sequentially extracts the 
packets designated from the MPEG transport stream in accordance with 
the instruction received from the reproduction controller 190, the 
buffer manager 160 checks, when the data stored in the payload 
portions of the packets are stored in the buffer 120, whether or not 
the buffer 120 overflows (step S301) . The decoding performed in the 
following manner differs depending on the presence or absence of the 
overflow of the buffer 120. 

[0032] When the buffer 120 does not overflow (No in step S302), 
the data extractor 110 stores the extracted data in the buffer 120 
(step S303). Subsequently, the data flow controller 130 
sequentially reads out the stored data from the buffer 120, and 
respectively specifies the separate buffers 141 (i = 1 to 3 in this 
example) at destinations of transfer in accordance with the set 
conditions (step S305) . When the data read out is the data stored 
in the packet having "Header 1", for example, the separate buffer 
141, which is the destination of transfer of the data, is specified. 
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[0033] On the other hand, when the buffer 120 overflows (Yes at 
step S302), the buffer manager 160 notifies the reproduction 
controller 190 that the buffer 120 overflows (step S401). The 
reproduction controller 190 which has been notified instructs the 
data extractor 110 to stop the data extraction (step S402) , and then 
instructs the decoding controller 180 to stop the decoding by all 
the decoders (step S403) . The decoding controller 180 instructs the 
data flow controller 130 to stop the data transfer to all the separate 
buffers 141 to 14n (step S404) , and instructs the buffer manager 160 
to initialize the buffer 120 (step S405) . The decoding controller 
180 which has received the instruction issues an instruction to stop 
the decoding by all the decoders 151 to 15n (step S406), and then 
instructs the separate buffer manager 170 to initialize all the 
separate buffers 141 to 14n (step S407). 

When the multiple decoding apparatus is entirely initialized 
by the processing, the processing from the step in which the decoding 
start instruction is outputted from the reproduction controller 190 
(step S201) to the step in which the separate buffer 14i is specified 
(step S305) is performed again. 

[0034] The separate buffer manager 170 then checks, when the data 
flow controller 130 stores in the specified separate buffer 14i the 
data read out of the buffer 120, whether or not the separate buffer 
14i overflows (step S306 ) . The decoding differs , as described below, 
depending on the presence or absence of the overflow of the separate 
buffer 14i. 
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[0035] First when the separate buffer 141 does not overflow (No 
in step S307), the data flow controller 130 stores the read data in 
the separate buffer 14i (step S308) . The decoder 15i decodes the 
data, when the data is stored in the separate buffer 14i (step S309) . 
5 The decoder 15i checks whether or not the decoded data, corresponding 
to a predetermined unit to be output ted, are ready for output (step 
S3 10) . When the decoded data are not ready for output, the decoder 
15i enters a stand-by state until the subsequent data arrives . When 
the decoded data are ready for output, the decoder 15i outputs the 

10 decoded data in the predetermined unit (step S311). 

Although description is herein made of a case where the decoded 
data are not outputted until they correspond to the predetermined 
unit to be outputted, the decoded data may be outputted as they are. 
[0036] On the other hand, when the separate buffer 14i overflows 

15 (Yes at step S307), two methods, described below, are considered as 
processes which can be carried out by the multiple decoding apparatus : 
[0037] (Process 1) 

The separate buffer manager 170 notifies the decoding 
controller 180 that the separate buffer 14i overflows (step S501). 

20 The decoding controller 180 which has been notified instructs the 
data flow controller 130 to stop the data transfer from the buffer 
120 to the separate buffer 14i (step S502) . During the stop, the 
data outputted from the data extractor 110 are stored in the buffer 
120. 

25 [0038] The data continues to be stored in the buffer 120 in a time 



period elapsed from the time when the data transfer by the data flow 
controller 130 is stopped until the data transfer is resumed. 
Accordingly, the size SI (bit) of the buffer 120 must be determined 
so as to satisfy the following relational expression: 
5 SI > S2 + RATE*T 

Here, assume that RATE(bit/sec) is the transfer rate of the 
data received from the data extractor 110 by the buffer 120, S2(bit) 
is the size of the data stored in the buffer 120 the moment the data 
flow controller 130 transfers the data, and T(sec) is a time period 

10 elapsed from the time when the data transfer by the data flow 
controller 130 is stopped until the data transfer is resumed. 
[0039] The decoding controller 180 then instructs the decoder 15i 
to stop the decoding (step S504) , and further instructs the separate 
buffer manager 170 to initialize the separate buffer 14i (step S505) . 

15 The separate buffer manager 170 which has received the instruction 
initializes the separate buffer 14i (step S506) . After the 
initialization, the decoding controller 180 instructs the decoder 
15i to start the decoding again (step S507), and instructs the 
separate buffer manager 170 to start data input to the separate buffer 

20 14i (step S508) . The decoding controller 180 instructs the data flow 
controller 130 to resume the data transfer (step S509), so that the 
data transfer from the buffer 120 to the separate buffer 14i is 
resumed . 

Thereafter, the processing in the step S210 and the subsequent 
25 steps is repeatedly performed. 



[0040] (Process 2) 

The separate buffer manager 170 notifies the decoding 
controller 180 that the separate buffer 14i overflows (step S601). 
The decoding controller 180 which has been notified instructs the 
5 data flow controller 130 to discard the data read out of the buffer 
120 to the separate buffer 14i (step S602) . The data flow controller 
130 which has received the instruction discards the corresponding 
data (step S603) . 

The decoding controller 180 then instructs the decoder 15i to 

10 stop the decoding (step S604), and instructs the separate buffer 
manager 170 to initialize the separate buffer manager 14i (step S605) . 
The separate buffer manager 170 which has received the instruction 
initializes the separate buffer 14i (step S606). After the 
initialization, the decoding controller 180 instructs the decoder 

15 15i to resume the decoding (step S607), and instructs the separate 
buffer manager 170 to resume the data input to the separate buffer 
14i from the buffer 120 (step S608) . The decoding controller 180 
then outputs to the data flow controller 130 an instruction to resume 
the data transfer of the corresponding data to the separate buffer 

20 14i (step S609). 

Thereafter, the processing in the step S210 and the subsequent 
steps is repeatedly performed. 

[0041] Although in the description of the (Process 2), the 
subsequent data input processing is performed upon recovering the 
25 separate buffer 14i which overflows after the data is discarded in 



the data flow controller 130, the subsequent data input processing 
may be performed asynchronously with overflow recovery processing 
after the data is discarded. 

[0042] As described in the foregoing, in the multiple decoding 
5 apparatus and method according to one embodiment of the present 
invention, a plurality of encoded data can be simultaneously decoded. 
Further, even when the buffer 120 or the separate buffers 141 to 14n 
overflow due to the occurrence of any error, it is feasible to recover 
unsuccessful decoding due to the error. 

10 [0043] Although description was made, taking as an example a case 
where the signal to be inputted is the MPEG transport stream, the 
signal to be inputted is not limited to the same. The signal to be 
inputted may be another signal, provided that it has identification 
information for identifying a plurality of data and has such a format 

15 that the plurality of data are mixed ( frequency-division multiplexed, 
time-division multiplexed, for example) . 

[0044] While the invention has been described in detail, the 
foregoing description is in all aspects illustrative and not 
restrictive. It is understood that numerous other modifications and 
20 variations can be devised without departing from the scope of the 
invention . 
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